rebase and fix lora config and file dep bug #28
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…dlePaddle#9604) * ckpt_support_moe * fix_bugs
* add xlm_roberta in paddlenlp
* update emb doc * update register_sequence_parallel_allreduce_hooks * update fuse_sequence_parallel_allreduce
* fix auto tokenizer * fix auto tokenizer * lint --------- Co-authored-by: lyuwenyu <[email protected]>
* update deepseek-v2 * add deepseek_v3 * update for deepseekv3 * update deepseekv3 model_ids
* open tensor_fusion for benchmark
* fix loraga merge * change sign
* [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * [AutoParallel]:fix ernine auto_trainer error * Update run_pretrain_auto.py
* Update README.md
* fix matryoshka norm
* fix sequence parallel * update register_sequence_parallel_allreduce_hooks * update fuse_sequence_parallel_allreduce
* [AutoParallel]:fix ci error * [AutoParallel]:fix ci error
* fix moe uc
…ePaddle#9787) * [LLM] support flash device on static model * [LLM] adapt pdc sdk
* add no_proxy & del paddlenlp_ops * update timeout for dpo * fix sequence_parallel * add timeout * add Total_Tokens_per_second_per_gpu * fix Tokens_per_second_per_gpu * update Total_Tokens_per_second_per_gpu
* mergekit gpu 1226 * merge model gpu * merge gpu * add lora model * change valueerror * add lora * gpu test
* [LLM] update llm server dockerfiles * merge code from fastdeploy
* Update README.md * Update README.md * Update README_en.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Before submitting
PR types
PR changes
Description
1.rebase
2.修复sft文件依赖错误，LoRAAutoConfig错误